Todd Chrisley swears he never slept with his ex-business partner ... 'cause if he did, the guy would’ve been hooked and coming back for more.